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FORMULATION OF THE INFORMATION CAPACITY OF THE 
OPTICAL-MECHANICAL LINE-SCAN IMAGING PROCESS 


Friedrich O. Huck and Stephen K. Park 
Langley Research Center 

SUMMARY 

The information capacity of the optical-mechanical line-scan imaging process is 
formulated by generally following the classical work of Fellgett and Linfoot who applied 
Shannon's theory of information to the assessment of film-camera images. Although 
images obtained with film cameras and optical-mechanical line-scan devices are both 
degraded by blurring of spatial detail and by noise, the latter images are also degraded by 
aliasing that results when spatial scene radiance variations are undersampled, and by 
quantization that results when the photosensor analog signal is converted to a digital sig- 
nal for transmission. 

Numerical evaluations of the derived expression reveal that both the information 
capacity for a fixed data density and the information efficiency (i.e., the ratio of informa- 
tion capacity to data density) exhibit a distinct single maximum when displayed as a func- 
tion of sampling rate, and that the location of this maximum is determined by the system 
frequency -response shape, signal-to-noise ratio, and quantization interval. These results 
suggest a general design criteria for optical-mechanical line-scan devices: namely, the 
optimization of either their information capacity for a fixed data density or their informa- 
tion efficiency, especially if large quantities of data are involved or the data must be trans- 
mitted over long distances. 


INTRODUCTION 

Film and television cameras have generally been employed in the past to characterize 
spatial variations of scene brightness, whereas optical -mechanical line-scan devices have 
been employed to characterize spectral and radiometric variations. Little attention has, 
therefore, been paid to the image quality of spatial detail obtained with the latter devices. 
However, the spatial characterization of scenes has become in recent years an important 
objective in several applications of the optical-mechanical line-scan technique to multi- 
spectral imaging systems for Earth-orbiting spacecraft; and it is the most important 
objective in applications to the so-called facsimile cameras of the U.S.S.R. spacecraft Luna 
(ref. 1) and Lunakhod (ref. 2) and the U.S. spacecraft Viking Lander (ref. 3). 



Data returned from Earth-orbiting spacecraft are constantly increasing, and data 
returned from planetary spacecraft will remain very expensive. In both cases, the quality 
of the data is most generally assessed by its information content, and the capability of the 
imaging system by its information capacity. The application of information theory to the 
assessment of optical-mechanical line-scan devices is particularly interesting because 
the quantity of data that is transmitted and the quantity of information that these data can 
contain are interrelated by two factors: the inevitable line-scan sampling process asso- 
ciated with this device, and the electronic sampling and quantization process required for 
digital data transmission. 

The approach that is pursued here to formulate the information capacity of the 
optical-mechanical line-scan imaging process generally follows the classical work of 
Fellgett and Linfoot (ref. 4) who applied Shannon’s theory of information (ref. 5) to the 
assessment of the image quality obtained with film cameras. Images obtained with film 
cameras and optical -mechanical line-scan devices are both degraded by blurring of small 
detail and by random noise. However, the latter images are also degraded by the aliasing 
that results when spatial scene radiance variations are undersampled and by the quantiza- 
tion that results when the photosensor analog signal is converted to a digital signal for 
transmission. 


SYMBOLS 


A 

|A| 

B 

F 


g(x^) 

g(u,o>) 


h 4 


H, 


isoplanatism patch of camera field of view 

solid angle of isoplanatism patch, sr 

sampling frequency passband 

camera frequency passband 

spatial function confined to A 

frequency spectrum of g(x,t//) confined to F 

data density, bits/sr 

information density or capacity, binits/sr 
quantity of data in A, bits 
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Hg 

Hi 

i(x,*) 

k 

K 

m,n 

M,N 

n e 

N(x,^) 

N(X) 

o(Xj^) 

p,q 

p(x,^) 

s(x^) 

S(u,u>) 

X,Y 

6 

V 

K 


entropy of g(x>^), binits 
quantity of information in A, binits 

random variable, minus its average value, of all signal and noise components 
in A 

filter-shape parameter (see fig. 3) 
average signal, A 

elevation and azimuth sampling counts, respectively 
number of elevation and azimuth samples, respectively 
magnitude of white Gaussian noise spectrum, A 

random variable, minus its average value, of all noise components in A 
average spectral radiance of object, W/m^-sr-pm 
normalized spatial distribution of object radiance 

elevation and azimuth integers of mathematical sampling points in F, 
respectively 

random variable, minus its average value, of all signal components in A 

spatial distribution of camera signal, A 

frequency spectrum of camera signal, A 

elevation and azimuth sampling intervals, respectively, rad 

delta or unit impulse function 

number of binary encoding levels, bits 

number of quantization levels 
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A 


wavelength, Mm 


a standard deviation 

t(x,^) point -spread function 

r(u,o>) spatial frequency response 

u,co elevation and azimuth spatial frequencies, respectively, rad"* 

u e cutoff frequency of electronic filter, rad - * 

T(u,oj) square root of r(v,a>) 

Wiener spectrum, or power spectral density 

X,i^ elevation and azimuth angles of camera scanning coordinates, respectively, 

rad 

1TT(x,^) sampling or comb function 

( — ) average value or ensemble average 

( ) spatial frequency domain 

( )*( ) convolution 

Subscripts: 

an aliasing noise 

c camera 

e electronics 

en electronic noise 

g spatial function gix,^) 

l lens 
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o 


optics 


ps proper signal 


FORMULATION 


The Optical-Mechanical Line-Scan Imaging Process 

Consider an optical-mechanical line-scan imaging device such as the facsimile cam- 
era shown in figure 1. Radiation from the object field is reflected by the scanning mirror, 
captured by the objective lens, and projected onto a plane which contains a photosensor 
covered by a small aperture. The photosensor converts the radiation falling on the aper- 
ture into an electrical signal which is then amplified, sampled, and quantized for digital 
transmission. As the mirror rotates, the imaged object field moves past the aperture and 
thus permits the aperture to scan vertical strips. The camera rotates in small steps 
between each vertical line scan until the entire object field of interest is scanned. The 
distance between object and camera is assumed to be large compared with the distance 
between camera mirror and lens; thus, spherical coordinates with an origin at the center 
of the objective lens can be used as reference for the elevation and azimuth imaging coor- 
dinates, labeled "x" and "i//," respectively. 

The process by which this device transfers the (continuous) object radiance distri- 
bution o(x,^) into a (discrete) electrical signal S(x,i^) can be approximately formulated 
by the equation (ref. 6) 


S(x,*) = K 


o(x^) 


(X,*) 


ITT 



( 1 ) 


The symbol * denotes convolution, K is the camera response to uniform radiance, and 
Tcix^) is the camera point -spread function which, in turn, is given by 


T c(x,^) = T Z (X,^) * T p (x, \Jy) * 



where r,(x,^), 


iWyH'/, T p(x^)> and r g (x) 6(i//) are the point- spread functions of the lens, 
photosensor aperture, and signal electronics, respectively. 


The symbol TTT 


(X. ± 

\X’Y 


) 


is the 


sampling (ref. 7) or comb (ref. 8) function. This function is an infinite sum of delta func- 
tions with spacings X and Y radians, which in this case correspond to the effective 
camera elevation and azimuth sampling intervals, respectively: 


I 1 5 (x =XY I I s <X-Xm,*-Yn) 

m — _ on — no ' • tyi — _ no — _nr> 


m=-°o n= -°° 


m=— °o n=-°° 
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For facsimile cameras used on planetary landers, the spacing Y is equal to the azimuth 
stepping interval times the cosine of x where x is measured from a plane normal to 
the optical axis of the objective lens. 

An approximation is introduced into the formulation of equation (1) by the separation 
of spectral and spatial object and camera characteristics, with the average signal K 
accounting for the spectral characteristics. Actually, o(x ,ty) and r c (x,i//) are functions 
of wavelength, and the spatial convolution should, therefore, be integrated over wavelength. 
However, it is convenient here to let (ref. 9) 

K = A c B c J N(X) t c (A) R(k) dX (2) 

where A is the area of the lens aperture, B is the solid angle of the field of view 
c c 

formed by the photosensor aperture (i.e., the solid angle that defines a picture element), 
N(A) is the average spectral radiance of the object, r c (x) is the transmittance of the 
camera optics, and R(x) is the responsivity of the photosensor. The use of K in equa- 
tion (1) permits o(x,^) and t^x,^) to be expressed as normalized functions while 
S(x,i^) takes on the unit of K, which is amperes. 

The optical-mechanical line-scan imaging process is implicitly a function of time. 

The formulation of equation (1) implies, therefore, that the convolution of the object radi- 
ance distribution with the camera point-spread function be performed for each picture 
element (pixel) in a picture to allow for changes of o(x ,^) or t c (x,^) with time. If 
neither object radiance distribution nor camera response varies with time (as is assumed 
here), then it is immaterial whether the pixels in a picture are formed simultaneously or 
in sequence, and the convolution needs to be performed only once for each picture. 

Significant variations in defocus blur and in azimuth sampling intervals, however, 
may occur as a function of the elevation scanning angle. If such variations occur, it is 
necessary for the purpose of analysis to divide the camera field of view into isoplanatism 
patches (i.e., areas within which these variations become negligibly small) and restrict all 
formulations to such a patch. The total information contained in an image is the sum of the 
information contained in all the patches that make up the image. 

An isoplanatism patch is denoted here by A and assumed to be rectangular and cen- 
tered at x = ^ = 0- For M samples per line scan and N line scans in A, x> and i/' 
are limited to 

-XM/2 S x = XM /2 

-YN/2 YN/2 
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and the solid angle subtended by A is |A| = XYMN steradians. Any spatial function 
g (Xf'k) is then said to be confined to A if g(x,i^) = 0 for all points outside A. The 
error that is introduced by confining the radiance distribution o(x,i^) to A is negligibly 
small everywhere in A except at a very narrow strip along the boundary of A. (See, for 
example, refs. 10 and 11.) 

The imaging process formulated by equation (1) is generally more convenient to eval- 
uate for the isoplanatism patch A in the frequency rather than spatial domain. Any spa- 
tial function g(x>^) which is confined to A and its corresponding frequency function 
g(u,w) are related by the Fourier transform pair 


g(u,u>) = g(x>^)e l27r ^ x+w< ^dxdi// 

gix,'!') = ^ g(u,ct»)e l27T ^ x du dw 

-oO 

By using this transformation, equation (1) becomes 

S(u,o>) = K o(u,co) 7- c (u,a))j * XY fTr(Xu,Ya;) 

where 


(3 a) 


^ c (u,w) = t l ( v ,u>) f p (u,u>) t q ( v ) 


and 


oo co 


XY W(Xu,Yo>) = £ £ 6 (y ' X ,C ° - Y 

m= -°° n= -oo 

Equation (3a) can be written more conveniently as 


OO OO 




m= -oo n=-°° 


or 


OO OO 


(3b) 


S(u,w) = K o(u,co) T c (u,w) + K ^ ^ ofu -^,a> -— ) T c (u -— , 0 ) -— ) (3c) 

m — _co n— _oo X / \ X Y/ 


m=-°° n=-°° 

(m,nM0,0) 
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The first term of the equation for S(u,cu) given by equation (3c), K 6(v,a>) t c (v,oj), is 
equal to the image frequency spectrum obtained with film cameras if r ( u,w) is inter- 
preted as the combined camera lens and film spatial frequency response and K as a 
(linear) film exposure-to-density transfer function. It is the existence of the sidebands 
given by the second term in equation (3c) that distinguishes the signal frequency spectrum 
generated by the optical-mechanical line -scan imaging process from the image frequency 
spectrum of the film camera. 

In order to characterize the signal frequency spectrum S(tj,o>), it is convenient to 
make the following two definitions : First, let F be the camera passband; ultimately, 


this passband is limited by the diffraction limit of the camera objective lens ^i.e., 

+ uft < ( — s * n — ^ , where sin a is the lens numerical aperture). Second, let B be 


the sampling passband with corner points v = and u> = ±^r and sides parallel to 

the frequency coordinates (u,w). Two cases must be recognized as illustrated in figure 2: 
(a) sufficient sampling when F c B; and (b) insufficient sampling, or undersampling, 
when F <£ B. 


If sufficient sampling occurs (fig. 2(a)), then the "proper signal" term 
K o(u,u>) r c (u,u)) can, in the absence of noise, be completely recovered by passing the 
signal frequency spectrum through an ideal low-pass filter whose passband agrees with 
the camera passband F or sampling passband B. However, if insufficient sampling 
occurs (fig. 2(b)), then the "proper signal" components cannot be completely recovered, 
because displaced, false -frequency components, called aliased signals, fall into the pass- 
band F. These aliased signal components cannot be distinguished in practice from the 
proper -signal components but tend to mask spatial detail in the image just like noise. The 
aliased signal is consequently treated as noise whose power is additive. 


Data Density 

Recall that M is the number of samples per line scan and N is the number of 
line scans in the isoplanatism patch A, and let k be the number of quantization levels 
of each sample. Then, the number of distinguishable states in A is k^N, anc j the 
amount of data in A is given by 

H d = MN log 2 K = M iog 2 k 

The units of are binary digits. It follows that the data density in A (i.e., the chan- 

nel capacity of the optical-mechanical line-scan device for the field of view I A l) is given 
by 
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(4a) 


h _ H a_ 


d |A| XY l0g2 K 


The units of are binary digits per steradian. For 77 -bit encoding, k = 2^ and 



(4b) 


If all the image states are independent and equally probable, then is the 

amount of information contained in A and h^ is the information density. However, all 
image states are generally neither independent nor equally probable in practice. To dis- 
tinguish between units of data and information, the unit "binary digits" will be abbreviated 
to "bits" for data and to "binits" for information. 


Information Density 

The spatial radiance distribution of natural scenes is generally not completely pre- 
dictable and must be treated as a random phenomenon. Otherwise, of course, the image 
data of such a scene could not be considered to carry any information. Image data of a 
reference test chart, for example, are not intended to provide information about the chart 
but about the camera performance. Consequently, an imaging system (just like a com- 
munication or control system) must be designed for an ensemble of scene radiances (or 
messages) and an ensemble of noise, not a particular scene radiance (or message) and a 
particular realization of noise. Wiener has shown that power spectral density is a mean- 
ingful and useful statistical description of random phenomena (ref. 12). For optical sys- 
tems, the power spectral density is often referred to as the Wiener spectrum to free the 
mathematical concept of a power spectral density from its physical implications in elec- 
trical engineering (ref. 13). 

Before formulating these statistics for the optical-mechanical line -scan imaging 
process, it is convenient to review a general analytical representation of random phe- 
nomena as presented by Fellgett and Linfoot (ref. 4) and by Linfoot (ref. 10) for optical 
images. Pertinent scene and camera characteristics are then molded into this analytical 
presentation, leading directly to the desired formulation of the information density gener- 
ated by the optical-mechanical line -scan imaging process. 

Analy tical representation . - Let the spatial function g(x,^) be a random process that 
represents any signal or noise component confined to the isoplanatism patch A of the 
reconstructed line-scan image; let the Fourier transform of this function g(u,w) be the 
corresponding frequency spectrum confined to the camera passband F; and let 

0 g (u,ca) = ji-j |g(u,ca)| 2 (5) 
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be the corresponding Wiener spectrum. In other words, the Wiener spectrum can be cal- 
culated by averaging the modulus squared of the Fourier transform of g(x,^), that is, 
|g(u,co)P, over the ensemble to which g(x,^) belongs and by dividing the result by the 
area | A|. 

The function g(x>4 / ) is real for the case of incoherent radiation treated here, so 
that the complex conjugate of g(u,o>) is equal to g(-u,-o>). The Wiener spectrum is 
always real, nonnegative, and symmetric about the origin ^i.e., 4>^(v,w) = 4> 

Furthermore, let g^ = be the value of g(u,a>) at the sampling points 

(up,<Uq) = (p/XM,q/YN), where p and q are integers. The sampling intervals 

(1/XM,1/YN) assure sufficient (mathematical) sampling since g(x,i//) is confined to A 
(i.e., |x|^XM/2,|xj SYN/2). The frequency function g(u,<n) can then be reconstructed 
from the sampled values according to Shannon’s sampling theorem (ref. 5) 

g(u,o>) ~ gpq sine (XMu - p) sine (YNoj - q) 
pqeF 


where 


sine v 


sin 7nj 
7TV 


and the notation pq e F indicates that the 
points in F. The spatial function 
expansion 


1 


g(x,^) = { 


I A | 



pqeF 



summation is performed over all sampling 
can be reconstructed by the Fourier series 



((X,^) e A) 


1° 


(tx.10 4 A) 


To avoid possible confusion it should be pointed out that the sampling intervals 
(1/XM,1/YN) in the frequency domain are not directly related to the camera sampling 
intervals (X,Y) in the spatial domain except through the somewhat arbitrarily defined solid 
angle J A | of the isoplanatism patch A. The former sampling intervals are introduced 
to provide a convenient analytical representation of scene and camera characteristics as 
a summation of discrete sampling values. The latter sampling intervals are an inherent 
aspect of the optical-mechanical line-scan imaging process. 

The statistical properties of any signal or noise component g(x,^) confined to A 
can be characterized by the statistical properties of the finite collection of complex random 
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variables gpq for which ( u p> w q^ £ F* If gpq has a probability distribution Ppq(g)> 
the entropy of gpq is defined as 


H gpq = " U Ppq (l) l0g 2 P pq (l) d? d * 


( 6 ) 


where £ and i; are the real and imaginary components of g respectively. Due to 
the conjugate symmetry of the collection of g^, only one -half of them can be assumed to 
be independent. With this understanding, the joint entropy of the collection of gpq (i.e., 
of g(u,w)) is given by 



pqeF 


Each sample value of gpq is assumed 
density function with mean zero and variance 
that is, 


to have 
ct 2 

g>pq 


a Gaussian (i.e., normal) probability 
equal to the average power of g • 

pq 


Ppq(g) 


2nc r 


g,pq 



2 

g,pq 


(8) 


where 



For a random variable with a specified variance, the Gaussian probability density function 
represents the maximum statistical uncertainty, or entropy, of the random variable. Sub- 
stituting this function into equations (6) and (7) yields the following familiar results 
(ref. 5): 


% = log 2 <9> 

H g 4 II l0S 2 4 ’^.pq < 10 > 

pqcF 

Now, let the spatial function I(x>'/ / ) be the random variable, minus its average 
value, that represents all the signal and noise components that have been constructed 
(without loss of information) in the isoplanatism patch A of the image; let the Fourier 
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transform of this function I(u,o;) be the corresponding frequency spectrum confined to 
the camera passband F; and let 0j(u,o>) be the corresponding Wiener spectrum. Simi- 
larly, let P(x,^) be the signal components of I(x,^), minus its average value, with 
P(u,cu) and 0p(u,w) the corresponding frequency and Wiener spectrum, respectively; 
and let N(x,^) be the noise components of I(x,^), with N(u,o>) and 0 N (u,co) the 
corresponding frequency and Wiener spectrum, respectively. It is assumed that the signal 
and noise components are additive and statistically independent, so that 

2 2 2 

oy = cry. + ar T 
I,M P,Pq N,pq 

In the sense that the information gained about a scene can be regarded as a reduction 
in the statistical uncertainty, or entropy, about the probable state of the scene, the quantity 
of information contained in is defined within the foregoing constraints as 



This summation can be approximated by an integration of a continuous function over F 
as 


i i c 

r 

0p(u,cu) 

wy. 

)f ‘° g 2 

1 + . 

0 N (u,w) 


du dco 


The information density in the isoplanatism patch A is then given by 




0p(u,u) 

1 + — 


du 


dcu 


( 12 ) 


The units of lu are binits per steradians. 

Object radiance .- The radiance distribution of a natural scene is taken to be 
N(x) o(x,i^) with the spectral and spatial characteristics separated for convenience. The 
spatial characteristics are given by the random variable o(x,^) which has the following 
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two constraints: (1) The variations of o(x,&) are effectively confined to the range 


0 £ o(x,*) ^ 2 
o(x^) = 0 


((X,i//) G A) 

((x»^) 3 A ) 


(2) The average value of o(x,^) is unity; that is, 


( 13 ) 


(14) 


An ensemble of scenes may be regarded to contain all scenes that consist of the same 
composition and have undergone the same morphological processes. The information con- 
tent of the scene is contained in the spatial distribution o(x,^) of the radiance. How- 
ever, it should be recognized that the average photosensor signal K is proportional to the 
spatial average value of the scene radiance N(\) (see eq. (2)) and that N(x) contributes, 
therefore, to the amount of information about the scene that can ultimately be recovered 
from the camera signal. With this understanding, the Wiener spectrum of the scene is 
defined as 


<£ 0 (u,co) = pi-j |o(u,co)| 2 


(15) 


where again |o(u,co)| 2 indicates that |o(u,u>)| 2 has been averaged over the ensemble to 
which 0 (u,oj) belongs. 

Camera signal .- The Wiener spectrum of the camera signal is defined as 
<P s (v,(x>) = |s(u,w)| 2 

where S(u,o>) is given by equations (3). It is assumed on practical grounds that the 
aliased signals are to be treated as noise - similar, for example, to the noise generated 
by the photosensor. It may be pointed out to emphasize this analogy that the Wiener spec- 
trum of the aliased signal, like that of the photosensor noise, may be assumed known; but 
a particular realization of either aliased signal or photosensor noise cannot be assumed 
known for any random process. The Wiener spectrum of the "proper signal" cp (u,co) 

-x A 

(i.e., of that component which is contained in the camera passband F when sufficient 
sampling occurs) is defined as 

^ps^’^ = K 2 0 o (u>") jr c (u,u>)j 2 ( 16 ) 
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Following Blackman and Tukey (ref. 14), the Wiener spectrum of the "aliased noise" 
^' e *’ of those components that are contained in F only when insufficient sam- 
pling occurs) is defined as 



(m,n)*(0,0) 


Electronic noise .- Noise is present in the object radiation itself, in the photosensor 
which transduces this radiation into an electrical signal, and in the electronic circuit 
which amplifies the small photosensor current into a signal large enough to be processed 
for transmission. Noise in the object radiation, referred to as photon noise, results from 
the random arrival of photons at the photosensor. However, the magnitude of this noise is 
significantly smaller than the noise generated in the solid-state photosensors and associ- 
ated electronics that would generally be used with optical-mechanical line-scan devices. 
The noise generated in photosensors can be divided into noise affected in magnitude by the 
presence of the arriving radiation, referred to as shot noise, and noise not so affected, 
referred to as dark current. The noise generated by the electronics is independent of the 
magnitude of the arriving radiation. It is generally too complicated to account rigorously 
for variations in shot noise as a function of variations in signal level; instead, an average 
value for the shot noise based on an average signal current K can readily be accounted 
for. This approximation applies in particular to low- contrast scenes. 

The electronic noise is amplified and sampled together with the signal for digital 
transmission. Just as undersampling of the signal frequency spectrum generates aliasing, 
so does undersampling of the noise frequency spectrum generate additional noise. How- 
ever, severe undersampling of the electronic-noise frequency spectrum that would generate 
a significant increase in the magnitude of the noise samples should generally be avoidable 
by proper shaping of the electronic frequency response f (u). The Wiener spectrum of 
the sampled noise at the output of the electronics becomes then 

= ^en (lj) | f eM 2 < 18) 

where 0 en (u) is the Wiener spectrum of the unfiltered electronic noise. 

Quantization noi se.- After the electrical signal (and noise) that has been generated 
along the line-scan direction is sampled, each one of the samples is also quantized for 
digital transmission. The quantization effect is a basic limitation of digital systems in 
determining the true value of a signal, just as random noise is a limitation of analog 
systems. 
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In order to determine the loss of information that results from quantization, it is 
necessary to account for some of the assumptions that have already been made about the 
signal and noise. Pertinent assumptions are: The average value of the signal is K and 
of the noise is zero; the probability density functions of signal and noise are Gaussian; and 
the effective range of signal variations is 2K. To form a valid model of the quantization 
process with these assumptions, it is necessary to assume also that the average-signal-to- 
rms -noise ratio is large - say, 10 or more. (This constraint is not serious in practice 
since only extremely poor images are reproduced from signals for which the signal-to- 
noise ratio is less than 10.) 

Additional assumptions are as follows: The signal is linearly quantized over its 
effective range 2K, so that the quantum levels have a uniform spacing of 2K /« where k 
is the number of quantization levels; the quantization error of any one sample is uncor- 
related with that of any other sample; and the signal occurs equally likely anywhere in the 
quantization interval -K / k to K / k . The last assumption is valid only if the number of 
quantization intervals is large - say, k = 16 (i.e., 4-bit encoding or more). 

These assumptions imply that the quantization error n^ has the uniform probability 
density function (ref. 15) 

e(\) = Sc (~ KA 5 n « s K/K ) 

= 0 (Elsewhere) 


In fact, a random variable which is constrained to a finite interval has maximum entropy 
when its probability density function is uniform. 

A signal that is uniformly distributed between -K//c and K/k has a mean equal to 
zero and a variance given by 



>K :/ K 
-K/k 


n 



dn 



Since quantization noise is uncorrelated (in the spatial domain), it has a Wiener spectrum 
equal to its variance; that is, 


4> Kn (v,u) = 


K 2 

3k 2 


(19) 


Quantization noise will be treated as additive white Gaussian noise with the Wiener 
spectrum given by equation (19). The fact that this treatment of quantization leads to rea- 
sonable results is demonstrated in the next section. 
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Formulation o f information density.- It remains now only to recognize that <£p(u,o>) 
in equation (12) is equal to the Wiener spectrum of the proper signal component 0p S (u,w) 
given by equation (16) and that 0 N (u,co) is equal to the sum of the Wiener spectrums of 
the aliased noise electronic noise and quantization noise <j> „„(v,w) 

given by equations (17), (18), and (19), respectively. Substituting these results into equa- 
tion (12) leads to the desired expression for the information density of the signal generated 
by the optical-mechanical line-scan imaging process: 


h i = Hi. l0g 2 


1 + 


<£ 0 (u,o>)|t c (i),w) 


— _0O TT — _00 


m= -°° n 
(m,n)*(0,0) 


+ K ' 2 ^en (lj) Pe (u) l + 1 K ' 2 


du do) 


(20) 


In order to support the treatment of quantization as additive noise and, hence, to 
explore the validity of equation (20), consider the following idealized situation. Let the 
Wiener spectrum of the camera signal with an effective range of 2K be 

2 2 

K 2 0 o (u,w)|t c (u,u))| = 2L 

= 0 

Consequently, the camera passband and sampling passband are the same (i.e., B = F), and 
the aliasing noise term is zero. Similarly, let the Wiener spectrum of the electronic noise 
with an effective range 2n g be 

2 

^en (lj) i T e (lj) | 2 = f 

= 0 

Equation (20) reduces then to 



Finally, let the electronic noise be small compared to the quantization interval; that is, 



(Elsewhere) 



(Elsewhere) 


16 




» n 


2 

e 


Then, equation (20) reduces further to 


h i = 5i'I- l0B 2( 1+ f“ 2 ) d ' ,d “’ = 


1 I 


If the number of quantization levels is large, then for this idealized situation 


h. 


B ? to «*!‘ 2 



K 


It is readily recognized that in this situation the information density h^ approaches — 
but remains slightly less than - the data density h^ given by equation (4a) . The fact that 
the maximum possible value of the ratio h^'h^ is slightly less than unity is consistent 
with the observation that h d represents the maximum possible information density for a 
spatial radiance distribution which is uniform rather than Gaussian. 


It is also informative to compare equation (20) with the general expression for infor- 
mation density derived by Fellgett and Linfoot (ref. 4, p. 399) for film-camera images as 
given here in the notation of this report: 


h. 


i,film 


= f l0g 2 


1 4 - 


0 o (u,O))|f if (u,O))|' 


0p(u,co)jr zf (u,o>)j 2 + 0 f (u ,a>) 


du dco 


where 0 o (u,a>), 0p(u,co), and $j(u,co) are the Wiener spectrum of the object radiance, 
photon noise, and film granularity, respectively, and t^(u,w) is the combined frequency 
response of the camera lens and film. It should be noted in particular that photon noise 
and aliased noise are similarly treated. Both are part of the object radiation, yet appear 
as statistically independent quantities. Furthermore, both their Wiener spectrums are 
modified by the frequency response of the camera. 


Information Capacity and Efficiency 

The information density lu formulated by equation (20) is a function of scene as 
well as camera characteristics. It is convenient to assume here that the Wiener spectrum 
of the scene is constant out to some frequency beyond the system response F. (See, for 
example, ref. 16.) Consistent with the previous assumption that the spatial radiance dis- 
tribution of the scene o(x,P) is Gaussian with an effective range of 2, its Wiener spec- 
trum 0 o (u,u>) is 1/4. It is also convenient to assume that the Wiener spectrum of the 
electronic noise is constant within the frequency passband of the electrical filter f (u), 
with magnitude & en M = n e /4. 


17 


With these assumptions, the (statistical mean) information capacity (in binits per 
steradian) of the optical-mechanical line-scan imaging process becomes 


h i - 1 5X* log 2 


1 + 


,2 

T C (U,C0)| 

1 1 


lu 


<1>)| 


2 + 4 -2 
+ 3 * 


m= -°° n= -oo 
(m,n)*(0,0) 


du do) 


( 21 ) 


The data density (in bits per steradian) that is inevitably associated with this information 
capacity is given by equation (4a) as 

h d = ^ lQ g2 K 

It can be recognized that the objective to maximize the information capacity h^ 
without regard to the associated data density h^ would lead to sufficient sampling and 
very small quantization intervals, and, therefore, to large data requirements. It may often 
be more desirable either to maximize h^ for a fixed value of h^ or to maximize the 
ratio h-^hjj. This ratio will be referred to as information efficiency. 

EVALUATION 


The foregoing formulation of the information capacity of the optical-mechanical line- 
scan imaging process was based in part on reasonable considerations of the effect of alias- 
ing and quantization rather than on strictly mathematical grounds. It is, therefore, desira- 
ble to demonstrate that these assumptions lead to reasonable results. 

Frequency -Response Shapes 

The realizability of frequency -response shapes of optical apertures is constrained 
by the requirement that the aperture transmission is always greater than zero. This con- 
straint may be generalized by noting that any aperture transmission function, being always 
positive, must have a square root; that is, r(x, ip) = Y 2 (x,i^), where r(x,i/') is the aper- 
ture response and T(x,^) is its square root. Taking the spatial Fourier transform and 
using the transform properties of the convolution yields 

oOO pOO 

t(u,u>) = \ \ T(u’,u)') T(u - u',oj - w')du' dw' 

oo ^ -oo 
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In words, any realizable transfer function must, in the spatial-frequency domain, be repre- 
sentable as the convolution of a function with itself. Given any response function, realizable 
or not (it must, of course, be the transform of a real function), a fully realizable one can 
be generated simply by convolving it with itself (ref. 17). 

The frequency -response characteristics of electrical filters are not similarly con- 
strained. Consequently, the overall frequency response of electro-optical systems can be 
shaped with greater freedom along the line-scan direction than along the azimuth-stepping 
direction. 

It is convenient here to consider only the simplified frequency -response shapes gen- 
erated by the function 

t(u,o>) = 1 - (v 2 + co 2 ) ^ (u 2 + co 2 ^ l) 

= 0 ^ u 2 + co 2 > 1 ^ 

where k > 0. (See fig. 3.) For electrical filters, f depends only on v and for large 
k becomes the approximately rectangular-shaped frequency response of ideal low-pass 
electrical filters. A cylindrical-shaped frequency response (i.e., the rectangular shape 
with circular symmetry) is not realizable for optical apertures; however, an approximately 
cone-shaped frequency response is realizable as can be shown by convolving the cylindrical 
shape with itself. In fact, this convolution yields the frequency response of a diffraction- 
limited lens (see, for example, ref. 9), which is approximated by equation (22) for k = 1. 

The remainder of this paper is concerned with four numerical examples. For con- 
venience, in all but the first example, the camera passband F is normalized to be the set 
of points (u,c o) with u 2 + ct> 2 ^ 1. Consequently, the Nyquist elevation and azimuth sam- 
pling rates are 1/X = 2 and l/Y = 2, respectively. In the first example only an elec- 
trical filter is considered for which the Nyquist rate is 1/X = 2. 

Examples 

The performance of the optical-mechanical line -scan imaging process for fixed sam- 
pling rates (1/X and l/Y) is determined — consistent with the assumptions that have been 
made - by the signal-to-noise ratio K/n e , the digital encoding level r?, the optical filter 
shape parameter k Q , the electrical filter shape parameter k e , and the electrical filter 
cutoff frequency u e - Table I presents a summary of values for these five parameters 
that are used in the following examples. 

Electrical filters .- Consider first a one -dimensional example that is representative 
of electrical filters. The information capacity analogous to equation (21) is 
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(23) 



m*0 


The frequency response of the electrical filter is given by 



where u g is the cutoff frequency. Analogous to equations (4), the associated data den- 
sity is 

h d = | log 2 K = | (25) 

The units of hr and h d are binits/radian and bits/radian, respectively. 

Often more useful and certainly more familiar is the information rate 
li. = x g h^ binits/second and the data rate h d = Xgh^ bits/ second, where x s is the 
mirror line-scan rate in radians/second. The information efficiency remains the same 
(i.e., h i /h d = hjh d ). 

Figure 4 illustrates the variation of information capacity tr, data density h d , and 
information efficiency h^h d with sampling rate 1/X. For reference: u g = 1; the 
Nyquist sampling rate is l/X = 2 cycles/radian; the root -mean -square (rms) magnitude 
of the electronic noise is 



for K/n g = 400 and k g = 1; and the rms magnitude of the quantization noise for 
rj = 8 bits is 

f§ k' 2 - 2'^ = 4.5 X10' 3 

The results shown in figure 4 are intuitively satisfying. It should be noted in par- 
ticular in figure 4(c) that the information efficiency approaches unity (h./h d = 0.9^ for a 
nearly ideal filter (k g = 4) and a nearly Nyquist sampling rate (l/X = 1.95) and that the 
peak information efficiency not only decreases with a poorer filter response but also shifts 
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toward lower sampling rates. Also, note in figure 4(b) that 10-bit encoding provides a 
significantly higher information capacity over 8-bit encoding, but that the latter provides 
a slightly higher information efficiency. Finally, note in figure 4(a) that a signal-to-noise 
ratio significantly higher than K/n e = 400 does not appreciably increase either h^ or 
hi/h^. 


Optical filters (symmet ric sampling) .- Consider next a two-dimensional example 
with circular symmetry that is representative of optical filters. The information capacity 
given by equation (21) becomes 



The frequency response of the optical filter is given by 



The associated data density given in equations (4) is 
h d = jfy l0 ^2 “ * xy 

The units of h^ and h d are binits/ steradian and bits/steradian, respectively. 

Results for h^ h d , and h^/h^ are plotted in figure 5 for symmetric elevation and 
azimuth sampling rates (i.e., 1/X = 1/Y). It should be noted by comparing figures 4 and 5 

that the information efficiency for optical filters tends to be substantially lower than for 
electrical filters. Also, the peak information efficiency tends to occur at substantially 
lower sampling rates than the Nyquist sampling rate 1/X = l/Y = 2. 

Optical filte rs (unsymmetric sampling) .- Consider next a two-dimensional example 
identical to the previous one except that the elevation and azimuth sampling rates, 1/X 
and 1/Y, respectively, are not restricted to be equal. Since the information capacity h i 
and efficiency h i /h d are then functions of two sampling rates, it is necessary to use a 
two-dimensional graphical representation of numerical solutions. Figure 6 presents a 
contour plot of information efficiency (i.e., lines of constant h iy /h d ) corresponding to the 
set of parameters K/n e = 400, r? = 8 bits, and k Q = 1. As would be expected, the con- 
tour lines have diagonal symmetry for a filter with circular symmetry. Consequently, the 
maximum information efficiency is obtained with symmetric sampling rates (i.e., 

I/X = 1/Y). 
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Figure 7(a) presents a contour plot of information capacity ho and three contours 
of constant data density h d . Figure 7(b) presents a plot of values of along the three 
contours of constant h d against the azimuth sampling rate 1/Y. Again, the maximum 
information capacity is obtained with symmetric sampling rates. 


Electro -optical systems.- Consider last a two-dimensional example without circular 
symmetry that is representative of electro -optical systems. The information capacity 
becomes 



The frequency response of the electrical filter is given by equations (24) and of the optical 
filter by equations (27). The associated data density is given by equations (4). 

Figure 8 presents a contour plot of the information efficiency h^|h d analogous to 
figure 6, but for K/n g = 400, r\ = 8 bits, k Q =1, k g = 4, and u = 0.8. Maximum 
values of h^h d still occur at sampling rates below the Nyquist rate. However, as would 
be expected, the location of these maximum values occurs off the diagonal at an elevation 
sampling rate which is lower than the azimuth sampling rate because of the additional 
electrical filtering along the elevation direction. 

Figure 9 presents information-capacity plots analogous to figure 7. Again, as in 
figure 8, the maximum information capacity for a fixed data density occurs at an elevation 
sampling rate lower than the azimuth sampling rate. 

CONCLUDING REMARKS 

Imaging systems cannot exactly reproduce a scene as an image. All images are 
degraded at least by some blurring of small detail and by random noise. As demonstrated 
by Fellgett and Linfoot, these two phenomena inevitably limit the amount of information 
density in an image. The optical-mechanical line-scan imaging process of many space- 
borne cameras almost unavoidably generates some additional image degradation due to 
aliasing and quantization. The results of Fellgett and Linfoot are extended here to include 
the effects of these degradations. All formulations are constrained by the assumption of 
statistically independent and additive Gaussian random processes, as have been all pre- 
vious related analyses for incoherent radiation. This assumption includes here in partic- 
ular the treatment of aliasing and quantization as noise sources. 
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The information density in an image depends not only on characteristics of the imag- 
ing system but also on statistical properties of the scene; namely, its random spatial radi- 
ance variation and power spectral density (i.e., Wiener spectrum). It is assumed that the 
radiance variation is Gaussian and that the Wiener spectrum is flat out to some spatial 
frequency beyond the optical passband of the imaging system. The information density of 
an image is then solely determined by the information capacity of the instrument used to 
obtain this image. 

The objective to maximize the information capacity of the optical-mechanical line- 
scan imaging process without regard to the associated data density can lead to unpracti- 
cally large data requirements. It may be preferable either to maximize the information 
capacity for a fixed data density or to maximize the information efficiency (i.e., the ratio 
of information capacity to data density). Both the information capacity for a fixed data 
density and the information efficiency exhibit a distinct single maximum when displayed as 
a function of sampling rate. 

It is shown that the information efficiency of an instrument can approach unity (i.e., 
that the information capacity of an instrument can approach the data density) under certain 
theoretical conditions. These conditions can be approximated in practice by electronic 
systems for time-varying signals but not by optical systems for space-varying signals. 

The reason for this is that the frequency response of electronic systems can approach a 
rectangular shape, whereas that of optical systems cannot approach a two-dimensional 
equivalent to this shape (i.e., a cylinderlike shape). In fact, the frequency response of 
an optical system is in practice generally limited by the conelike shape of a diffraction- 
limited lens, limiting the information efficiency of optical-mechanical line-scan devices to 
considerably less than unity. Nevertheless, within this limit, the information efficiency 
can vary significantly with sampling rate, signal-to-noise ratio, and quantization interval, 
as has been illustrated for a wide range of reasonable camera frequency -response shapes. 

Langley Research Center, 

National Aeronautics and Space Administration, 

Hampton, Va., April 22, 1975. 
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TABLE I.- SUMMARY OF EXAMPLES 


Systems 



Parameters 


K/n e 

V, 

bits 

k o 

k e 

^e 

Electrical filter 

100 

6 

Not applicable 

0.25 

1 


400 

8 


1 

1 


1600 

10 


4 

1 

Optical filter, symmetric sampling 

100 

6 

0.25 

Not applicable 


400 

8 

.5 




1600 

10 

1 



Optical filter, unsymmetric sampling 

400 

8 

1 

Not applicable 

Electro-optical filter, unsymmetric 

400 

8 

1 

4 

0.8 

sampling 
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(a) Sufficient sampling. 



(b) Insufficient sampling. 

Figure 2.- Frequency spectrum generated by the optical-mechanical 

line -scan imaging process. 








(a) Contour plot of information capacity and three contours of constant data 
density as a function of sampling rates 1/X and 1/Y. 

(b) Plot of along the three contours of constant h^ against sampling rate 1/Y. 

Figure 7.- Plots of information capacity for optical filters. K/n e = 400; ri = 8 bits; 

and k Q = 1. 
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(a) Contour plot of information capacity and three contours of constant data 
density as a function of sampling rates 1/X and 1/Y. 

(b) Plot of hu along the three contours of constant h^ against sampling rate 1/Y. 

Figure 9.- Plots of information capacity for electro-optical systems. K/ n e = 400; 
rj = 8 bits; k Q =1; k 0 = 4; and u e = 0.8. 
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